s 
Wooy SI] WOl4 Oye] JON Og 
JONIUIIIY Ys 
== Vi \ ‘ ogee | 
BAAN eke ; Be hd Ps, wee PP EY 1S oc Cv) a | « | ao@e “i 
No ae es a ks WV FEO IVE D pve wo) : eae 2 SVio> Oy | 


SF 


4 
4 


) 


te LOS 


Pe MURR inp Teno Oe 
a 


| 
| 


i 


ta 
br 


Pe ee ee 


S- sie 


a eet mn . = 
CME ae PORE SE PS MARIE PIS LL ES SOAR LIES AE OE NER 


BOSTON UNIVERSITY 
SCHOOL OF EDUCATION 


LIBRARY 


——— sss e———eEaEOoOoOoOOQuQQE 


BOSTON UNIVERSITY 
SCHOOL OF EDUCATION 


THE CONSTRUCTION AND VALIDATION OF A TEST ON 
POST-WAR INTERNATIONAL AFFAIRS 


A Thesis 


_. Submitted By 
Br. Kenneth Wilmot Cook 
| (A.B., Dartmouth College, 1943) 
In Partial Fulfillment of Requirements for 
the Degree of Master of Education 
1949 
an . ' 
First Reader : William H. Cartwright 


N iv as 
“Second Reader: Worcester Warren 


ird Reader : Charles L. Peltier 


iy 


Sehool oL-eduratien, 
Or ry, 444 
Blo rs 


TABLE OF CONTENTS 


CHAPTER 


IL LOTR ORDUCTEON, 2G Ueces bee ode e eee ete ee See vedeeudeee 


EE 


BIBLIOGRAPHY a's € Bis €. B&O 6 6.'e ee. e 6: & Se ceseeveevee eee 


APPENDIX S246 8 CC 6 2 ee 62 6 Oe 6 8 0 2.e © 8 8.6 & 6 ee 


The Problem 
Related Research 


CONSTRUCTION OF THE TEST......0- 


The Test 


ADMINISTRATION OF THE EO ad oad ave ta wikia wiceen anata erate adn 


ANALYSIS OF THE DATA a 2.0.8 6 6. 6 €¢ 8 616 2h 2 Oe Oe CC) 6 C10: e' Oo 8 


SUMMARY AND CONCLUSIONS ........ 


A The Item Analysis cccccwees 


PAGE 


TABLE 


I Percentages 
A«s, B., and 


II Percentages 
Cey De, and 


III Percentages 


Iv Percentages 


of 
C. 


of 
Es 


of 


of 


LIST OF TABLES 


PAGE 


correct responses of Schools 


eseeteevpetopoeseevoevo ee eeeeeseseeee eevee e8s 208 29 


correct responses of Schools 


@eseeoeeweeereeveeeeeeeee*eevreeeeeseeoeesee eee eee @ Je 
total correct responses cecccccccee 35 


correct responses in Expert Group.. 36 


V Compsrison of pupil and expert group performance.. 37 


VI Raw scores, Medians, and Standard Deviations of 
pupils and expert ZrouPp cececrcecrsccsccccecccccoes 39 


CHAPTER I 


INTRODUCTION 


1. The Problem 


Statement of the Problem, The purpose of this study is | 


the construction and evaluation of a teacher-made ob jective 
type test in the field of Problems of Democracy. By means of 
this evaluation the writer hopes to be able to determine how 
well informed the pupils of this area are in the field of 


international affairs. 


One of the primary objectives of a class in Problems of 


Democracy is the training of youth to understand the critical 
issues which they will be asked to decide with their vote. 
International affairs have become very complex. America has 
become the nerve center of world politics. It is no longer 
possible for Americans to pursue a policy of isolation and 
indifference to American foreign negotiations. The pupils in 
the high schools in our country are more aware of the respon- 
sibilities which face them than ever before. 

In this study the writer hopes to find the areas in 
international affairs which need more attention in the class- 
room. The writer will also point out the areas in which the 
schools of this area are doing the best work, as evidenced by 


an analysis of the data. 


i 


Related Research. Reporting on the necessity of tests 


= 


Kelly and Krey said, 


It is not likely that pupils will cease to desire 

to submit the evidence of their learning at intervals 
both to satisfy themselves in the certainty of their 
progress and to gain the friendly help of those who 

are the masters of learning. It seems no less likely 
that conscientious teachers will continue to reassure 
themselves by test of the satisfactory completion of 
one stage of work before entering upon the next stage. 
In reference to the importance of testing, Kronenberg 


concluded: 


By means of a carefully constructed objective examina-= 
tion most of the essential points in a course may be 
touched and by so doing the students sare given a fair 
opportunity to demonstrate what they have learned. 


As further evidence Kronenberg states: "Theoretical | 


considerations and experimental evidence lead to the conclusion 
that objective tests devised by instructors are more valid | 
measures than ready made commercial tests."5 | 

Evidence seems to indicate that a teacher made objective 


test is highly desirable. In a summary of investigations Lee | 


and Symonds? found that previous studies indicated that teacher 


1 Truman Kelley and A. C. Krey, Tests and Measurements 
in the Social Studies. New York: Charles Scribner and Sons, 
1934, p. 1035. 


2 Henry Kronenberg, "The Influence of Objective Testing | 
on Methods of Teaching," Fifth Yearbook National Council for | 
Social Studies, 1935, p. 1966 | 


5 Ibid., p. 198. 
4 J. Murray Lee and J. Percival Symonds, "Objective 


Tests a Summary of Recent Investigations," Journal of Educa- 
tional Psychology, March, 1934, p. 167. 


made objective tests can be as valid as standardized tests 


and in some cases more so. 


The scope of this study is the time between the end 


of World War II and February of the present year. Any test 


covering that period might well be considered a test of 


to this fact a search of the test lit- 


current events. Due 


All the leading testing 


erature was not very successful. 


companies were queried as to the availability of such a 


test. No test was found which covered the exact field of 


this study. The most satisfactory instruments found were 


the "Examination in Problems of Democracy", published by 


the Cooperative Test Service of the American Council on 


Education and the tests which are constructed and published 


by Time magazine. The tests from Time magazine were especial- 


ly helpful and the writer gained many helpful ideas from 


theme It was found that the tests usually contained items 


They were items which 


requiring very specific information. 


would be known at the time but mould not necessarily be 


kept in the memory for a long time. They definitely tested 


information of immediate interest but lacked somewhat in the 


testing of understandings. 


Therefore, the test which the author of this study pro- 


duced is the work of the writer himself. As was stated above, 


many ideas were gained from the Time magazine techniques 
studied but the writer takes the responsibility for the form 


| of the test. 


Research into the literature of the field shows a 
pronounced lack of available tests. The field is in need of 


reliable instruments to fill a Yeal need. 


that there was remarkably little difference between the items. 


CHAPTER II ! 
CONSTRUCTION OF THE TEST 


Selection of the items. Before the test could be con- 
structed it was necessary to determine the scope of the items. 
It was decided that the test should cover events on American | 
post-wer international relations, beginning immediately after | 
the cessation of hostilities in the fall of 1945. It was aso | 
decided that very recent events would not be over emphasized | 
but rather that events which had already been settled by ne- 
gotiation would be included in the test. Having determined 
the time limits of the period under study, the next thing was | 
to study the sources from which the test items might be drawn. 
These sources were many and it was found early that a few wel | 


chosen sources would be sufficient. 


The first source considered was the group of weekly and 
monthly magazines which are used by many schools for their | 
Problems of Democracy and current events classes. These maga- 
zines include Current Events, Our Times, and Junior Review. 


A careful study of the main topics presented showed clearly 


that the issues presented by all three were toal intent and 


purposes the same, The main difference was the amount of detail 
included. In order to be certain that the above observations 


were correct a tabulation was made. The tabulation vroved 


—_ —— — —— ail = 


On the basis of this tabulation a list of topics was | 


developed. The writer developed an outline from the topics ] 
| 


possible to group the material under ten main headings. These. 


which had been derived, After considerable study it was found 


ten topics were found to be broad enough to cover all the 


items necessary for a satisfactory survey of the entire period 


under consideration. The construction of the outline made it 
possible for the writer to make evaluations as to the relative | 
importance of the various topics and to determine the number of 
items which each topic should be allotted in the test. | 
The outline was carefully designed and seemed a rea- 
listic grouping of an extensive group of events. It was thought 
necessary that expert opinion pass on this outline in order 
that its validity could be assured. Consequently Professor 
| Lashley G. Harvey, Associate Professor of Government of Boston | 
University and Professor Franklin C,. Erickson, Associate Prof- | 
essor of Geography of Boston University were approached for 
advice. Both professors gave helpful and constructive aid. 
Their criticisms were taken into consideration and the results 
of the conferences with the above named professors gave much 
more meaning to the outline itself. The writer is very grate-~ | 
ful for their aid in making the study more meaningful and valid, 
After the basis of the test had been definitely decided | 
it was possible to go ahead with the construction of the items 


to be used. The test was to be fully objective. The next step 


eee te Se es 


was to determine the type of objective items to be used. 


Greene, Jorgensen and Gerberich in their chapter on the "Con- 


9 nit 


struction and Use of Informal Tests state: 

The multiple-choice and its numerous variants perhaps 
represent the most valuable and at the same time the 
most widely applicable type of objective test item. 

It is highly objective in scoring. It is readily, al- 
though not necessarily easily adaptable to the measure- 
ment of discriminative power, inferential reasoning, 
interpretative ability, reasoned understanding, gener- | 
alizing ability, and other types of outcomes deriving 
from the pupil's ability to apply and use facts. It 
is not difficult for pupils to understand and.use. It 
is highly objective, and can be readily scored either 
by hand or by machine. Item-count procedures based on 
the results for an individual pupil or class have con- 
siderable diagnostic and analytic significance ... 
Multiple-choice tiems are not easily constructed as 
are some other objective test forms, for there are 
various technical problems which require great care in 
the drafting of items. The incorrect answers pupils 
give to simple recall items often serve as excellent 
incorrect alternatives if_the item is converted into 
the multiple-choice form. 


The suggestions given by Greene, Jorgensen and Gerberich 
for constructing multiple-choice items were followed as closely 
as possible. The above authors give ten specific suggestions 
in the construction of some items. They are: 


(1) As much of the statement as possible should occur 
in the introductory portion. 


(2) Alternative answers should all be stated in correct 
grammatical style. 


(3) Incorrect alternatives, or confusions, should be 
Do plausible. 


1 Harry A. Greene and others, Measurement and Evaluation 
in the Secondary School» New York: Longmans, Green and Co., 


1943, ppe 177-178. 


os 


(4) "Aa" or "an" should not ordinarily be used to 
introduce the alternative answers. 


(5) Items should ordinarily have the same number of 
alternative answers. 


(6) All items should ordinarily have four or five 
alternative answers. 


(7) Alternative answers should ordinarily occur at the. 
end of the statement. 


(8) Answers should be required in a highly objective 
forme 


(9) Correct responses should be distributed with app- | 
roximate equality among possible answer positions. 


(10) Randgm occurrence of correct responses should be 
employede~ 


Using the above suggestions a large number of items were 
constructed. The most satisfactory ones were chosen for in- 
clusion in the test only after each of the above criteria had 
been fulfilled. The number of items from each topic of the 
outline was decided after the decision had been made as to the 
relative importance of the topics in the outline. As the test 
was to be administered by classroom teachers in one class 
period, the length of the test had to be kept foremost in mind. 
It was decided that sixty-two items would be a reasonable num- 
ber of items for the average class period of the schools of the 


Greater Boston area. It was obvious that this limitation would 


2 Ibid., pp. 192 ff. 


mean that the outline could not be covered with any real degree 
of thoroughness. Therefore the outline was again considered 
and the topics re-rated. Professor Franklin C. Erickson again 
aided the writer and upon his advice the number of items from 
each topic was sete At the end of this chapter a chart is 
included to show the result of this conference. 

It was finally decided that fourteen items on the 
work of the United Nations would be used in the final test. A 
knowledge of top governmental and military personalities was 
rated as next in dnedeuai eon It was decided that there should 
be sixteen items from this topic on the final test. Military 
pacts and occupation affairs were rated third and ten items 
were allotted to this topic. The remaining number of items, 
twenty-two in number, were distributed among the topics not 
mentioned above. There was by force of necessity some over- 
lapping but the final decisions on the rating of the outline 
seem reasonable when the whole test is taken into consideratio 


In the following section is the outline and the test 


which was constructed for use in this study. 


10 


CHART SHOWING NUMBER OF ITEMS CHOSEN FROM 
EACH SECTION OF THE OUTLINE 


TOPIC NUMBER 
1. The United Nations 14 


2. The Truman Doctrine +) 
Se The Marshall Plan 7 
4. Inter-American Affairs o 
5. Foreign Minister Conferences L 
6. War Trials a 
7. Government and Military Personali- 
ties 16 
8. Military Affairs 10 
9. The Far East 4 
10. Important Affairs Not in above 
topics 2 
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AN OUTLINE OF AMERICAN POST-WAR INTERNATIONAL AFFAIRS 


TO BE USED AS BASIS FOR TEST ITEMS 


A. THE UNITED NATIONS 


1) organization 

2) major personalities 

3) important problems handled 
4) successes and failures 

5) history of the veto power 
6) present status 

7) future outlook 


B. THE MARSHALL PLAN 


1) reasons for establishment 

2) major personalities 

3) establishment of the E.C.A. 

4) adoption of the plan by sixteen nations 
5) efforts of Russia to embarrass it 

6) successes and failures 

7) effects on elections in Europe 

8) financing 

9) present status 
10) future outlook 


C. THE TRUMAN DOCTRINE 


1) reasons for adoption 

2) countries affected 

3) successes and failures 

4) present status 

5) future outlook 

6) relationship with the Marshall Plan 


D. FOREIGN MINISTER CONFERENCES 


1) writing of axis satellite peace treaties 
2) conflict over Trieste 
3) disposition of Italian colonies 
4) Austrian treaty negotiations 
5) German treaty negotiations 
- J 6) Berlin Blockade 
7) Far Eastern Commission 


=F 
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CRIMES TRIALS 


Nurenberg trials 

Tokyo trials 

legal significance 

precedents set for future 

reactions of native populations affected 


INTER-AMERICAN AFFAIRS 


Bogota conference 

Rio de Janeiro conference 

diplomatic difficulties in the Canal Zone 
present status of relations with Argentina 
anti-communist activities of South American 
countries 


THE FAR EAST 


2) 
‘3 


the Chinese civil war 

the status of the Philippines 
the recognition of India 

the recognition of Pakistan 


MILITARY AFFAIRS 


occupation of Germany 

Occupation of Austria 

occupation of Japan 

occupation of Korea 

operations in Greece and Turkey 

aid given to China 

atomic tests 

Far Eastern League 

North Atlantic Pact 

naval policy in Atlantic and Pacific Oceans 


GOVERNMENT AND MILITARY PERSONALITIES 


presidents 

foreign ministers 

United States' policy makers 

Main figures in the Defense Department 
importance of roles played in foreign affairs 


IMPORTANT AFFAIRS NOT LISTED IN TOPICS ABOVE 


1) Olympiad 
2) Voice of America 
3) The United States Information Service 


4) Student exchanges 


on 
AMERICAN POST-WAR INTERNATIONAL AFFAIRS 
CONSTRUCTED 


BY 


Kenneth Wilmot Cook 


January 1949 


, 


A TEST 
on 
American Post-War International Relations 
Constructed By 


Kenneth W. Cook 


INSTRUCTIONS: 


1. This test is divided into three parts. Part I 
consists of multiple choice questions. Part II consists of 
matching type questions and Part III consists of reverse 
multiple choice questions. 


2. An answer sheet is provided. The test should 
not be marked with your pencil. 


3. The test consists of sixty two (62) items. You 
will have sufficient time to complete it. Therefore, 
finish one section and check it before going on to the 
next section. 


PART 2 


Read the directions on your answer sheet. Indicate 
on the answer sheet the answer you think most nearly 
correct. All the choices may be partly true but only 
one is entirely correct. 


1. The Security Council of the United Nations: 


a) may send an armed force to areas where disputes 
exist 

b) has authority to look into any dispute which | 
endangers national peace and security 

ec) does not often resort to the use of the veto power 

dad) has been successful in settling disputes which 
have been brought before it 


Ze 


4. 


Se 


66 


16 


An organization whose duty it is to collect information. 
about foreign powers of every hemisphere is the: 


The 


national sovereignty due to the fact that: 


The 


Truman Doctrine because: 


f) 
g) 


h) 
i) 


At 


a) 
b) 
c) 
d) 


General Clay is the: 


f 
; 


i) 


the 1948 meeting of the General Assembly of the 
United Nations: 


Central Intelligence Agency 

G=-2 

Federal Bureau of Investigation 
Counter Intelligence Corps 


General Assembly of the United Nations limits 


all nations have an equal voice and vote 

minor decisions require only a simple majority 
it may look into any matter not being considered 
by the Security Council at the same time 
major decisions are made by a three-fourths vote 
of the members present 


United States has sent aid to Greece under the 


we have close racial ties with the Greek people 
the present Greek government is held in high regard 
by the United States 

the British government could no longer bear the 
financial burden 

the U. S. does not desire Russian expansion in the 
Mediterranean 


an important statement of human rights was adopted 
progress was made in settling the Palestine problem 
Austria was granted United Nations membership 
important action was taken toward writing the peace 
treaty for Germany 


commander of all U.S. forces in the European Theater 
Chief of Staff of the U. S. Army 
Commander of the U. S. forces in Germany and Austria 
military governor of the American Zone of Germany 


fi Ls 


9. 


10. 


ll. 


The Security Council of the United Nations: 


a) has seven permanent members 

b) usually meets at Lake Success, New York 

ec) is the most powerful branch of the United Nations 
d) often bows to the authority of the General Assembly 


A revolution broke out in Bogota, Columbia in April 
1948: 


f) to protest U. S. demands for more privileges 

g) because of unfriendly acts by Juan Peron 

h) during an Inter-American conference in that city 

i) in protest of communist infiltration of the 
Columbian government 


The term "Cold War": 


a) refers to the war between the Jews and Arabs 


b) refers to the strained diplomatic relations between | 


nations of the west and those of the Soviet sphere 
ec) is used when discussing relations between China's 
Nationalist government and the Chinese communists 
d) was first used by Winston Churchill in a speech in 
Missouri 


Spain has not been included in the list of nations to 
receive aid under the Marshall Plan because her 
government is considered: 


f) communistic 
g) fascist 

h) socialistic 
i) imperialistic 


When using the term "The Iron Curtain" we are referring 
to: 


a) an imaginary line which separates those European 
nations under Russian influence from the West 

b) a term coined by President Truman soon after the 
end of the war 

¢) a political division which no longer exists 

ad) the Balkan area of Europe 
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12. 


13. 


14. 


15. 


16. 


Canada is now trying to buy fewer products from the 
United States because: 


The 
a) 
b) 
é) 


da) 


Countries which have been aided under the Truman 
Doctrine include: 


chief purpose of the "Voice of America" is to: 


influence the Russian people against their 
government 

encourage Europeans to revolt 

help foreigners to understand what the U. S. is 
trying to do to promote prosperity and 
understanding 

propagandize the power of the United States 


Chinese communists have: 


been forcing the Nationalist forces to withdraw 
on nearly all fronts 
lost ground to the armies of Chiang-Kai-Shek 


been forced to sue for peace | 
recently broken off relations with the Russian | 
communists | 


prices in the U.S. are too high 

better quality goods can be brought elsewhere 

she prefers to trade with Great Britain 

she lacks dollars with which to pay for the goods 


living standard of the British people has suffered | 
since the war because: 


aid from the U.S. has been very limited 
the labor government has tried to nationalize 
the industry too fast 


their government has been too interested in foreign 


problems 
England has not been able to produce enough goods 
to pay for the products she must import 


Germany and Austria 
Japan and China 
Greece and Turkey 
England and France 


19 


17. The present state of Israel was controlled from the 
end of World War I until 1948 by: 


a) France 

bd) Great Britain 

ce) Turkey 

d) League of Nations 


18. A permanent member of the Security Council is: 


f) China 
g) Canada 
h) Egypt 
i) India 


19. The primary interest of the United States in keeping 
peace with the Arab League is the: 


a) presence of oil deposits in the Near East 

b) desire to keep Russia out of the area 

c) position of the Suez Canal 

ec) maintenance of existing trade agreements with 
Near Eastern countries 


20. Count Bernadotte was assassinated: 


f) while trying to bring about peace in Indonesia 

g) by persons infuriated over the partition of India 
h) while endeavoring to settle Palestinian problems 
i) while on personal business in the Near East 


PART II 


The following are matching questions. On the left 
side of the page are statements. On the right side are 
names of persons and places which correspond to these 
statements. For each three statements, there are five 
choices: 


21. Permanent home of the United Nations a) Bled 


b) New York 


22. City contested by Italy and Yugoslavia c) Trieste 


23. Scene of the 1948 Olympiad d) SanFrancisco 


e) Wembley 
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24.6 


256 


266 


27. 


28. 


296 


50. 
ole 
S26 


356 


346 


O56 


566 


37. 


58. 


596 


40, 
41. 


Director of the E.C.A. 


Commander of U.S. forces in Japan 


Canadian government leader recently 


retired 
Present prime minister of Great 
Britain 


Author of plan to reduce Germany 
to an agricultural state 


U.Se ambassador to London 


Rumanian foreign minister 
Russian foreign minister 

French foreign minister 

Deceased ex=-president of Czecho- 
slovakia 

President of France 

President of Mexico 

President of the last meeting 

of the United Nations 


Catholic cardinal arrested in 
Hungary 


Statesman who replaced W. M. King 


as party leader in Canada 


Permanent U.S. delegate to the UN 


Secretary General of the UN 


U.S. Secretary ao National Defense 


a) John Dulles 
b) Gen. Keyes 

ec) WM. King 

d) Paul Hoffman 
e) Gen.MacArthur 


a)Winston Chur- 
ehill 

b)Lewis Douglas 

c)Clement Attlee 

d)Henry Morgen- 
thau 

e)Joseph Grady 


a) Karl Gruber | 
b) Robert Schumam 
c) Anna Pauker 
d) V. Molotov 
e) Andrei Gromyko 


a) Miguel Aleman | 
b) Pierre Cot | 
ec) Vincent Auriol 
dad) Edouard Benes 
e) Juan Peron 


a) Stepinac 

b) Mindszenty 
ec) St. Laurent 
d) Eden 

e) Evatt 


a) JamesForrestal | 
b) Trygve Lie | 
c) Philip Jessup 
ad) Warren Austin 
e) Omar Bradley 


* 


42. Yugoslav leader in disfavor with 


Moscow 

J 43. Russian schoolteacher who jumped a) Alcide Gasperi 
from window of Russian consulate b) Marshal Tito 
in New York c) Oskana Kasenkina 


d) Pietro Nenni 
44, Premier of Italy elected on anti- ee) Petru Grosza 
communist ticket 


45. Author of plan for international 
control of atomic energy ) William Bullitt 
) Dean Acheson 
) Clifton Webb 
Bernard Baruch 


) George Marshall 


surveyed the Chinese situation 


a 
b 
46. American diplomat who recently ¢€ 
d 
e 


47. Present U.S. Secretary of State 


48. Leader of Greek rebels a) Barnett 
b) Polk 
49. Assassinated Columbian politician ec) Gaitan 
ad) Fernandes 
50. American assassinated in Greece e) Markos 


51. New Chinese National government 


headquarters 
a) Shanghai 
52. Area under dispute by Israel and b) Negeb 
Egypt ec) Canton 


d) Azerbaijan 
53. Area formally disputed by Russia e) Carinthia 
and Iram 


PART iT 


Part III consists of REVERSE multiple choice questions. 
Read the question thoroughly and indicate on your answer 
)) sheet the answer which is not correct. 


22 


54. 


556 


566 


57. 


58. 


59. 


Dean Acheson's appointment as Secretary of State 


was 


The War Crimes Tribunal at Nurnberg: 


At the present time in Korea: 


fl there are no Russian troops on occupation duty 
gZ there are a number of American troops on duty 
h) a national government is functioning 
i) a UN committee is surveying the problem of Korean 
unity 
The country which does not presently support the North 
Atlantic Pact is: 
a) Spain 
b) Portugal 
e) Sweden 
d) England 
The proposed North Atlantic Pact: 


not favored by some people because: 


they considered him an appeaser of Russia 
he was unsympathetic to the Marshall Plan 
of his association with the Hiss brothers 
of his personal contacts with Wall Street 


Cominform was organized to: 


embarrass the efforts of the U.S. to aid 
countries of Europe 

compete with the Marshall Plan 

force Marshal Tito to come back into the 
Russian sphere 


sentenced German public officials to death 
sentenced only military persons to death 

was the first international tribunal to try 

war criminals 

did not agree unanimously on the sentences given 


may be signed by some Scandinavian countries 
will probably come before the U.S. Senate this 
year 

will mean the end of traditional U.S. isolationism 
is not considered a real threat by the USSR 


a == 
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60. 


61. 


‘62.6 


President Truman's inaugural speech did not: 


a) contain a sympathetic stand against communism 
b) get a warm reception from European countries 
ec) ask for a compromise with communism 

d) receive the approval of Henry Wallace 


The Far Eastern League suggested by India: 


f) violates the principles of the United Nations 

g) was brought into being after the Dutch offensive 
in Indonesia 

h) will encourage the rise of nationalism in the 
Far East 

i) indicates the growth of political maturity of 
the new state of India 


The establishment of the Economic Council for Mutual 
Aid: 


a) is a recent move of the USSR 

b) was initiated by our new Secretary of State 
ec) does not include the nations of the Far East 
a) will supplement the work of the Cominform 


a 


CHAPTER III 


ADMINISTRATION OF THE TEST 


Once the test had been constructed the problem of its 


administration was studied with the writer's adviser, who 
suggested that the services of the student teachers of the | 
Social Studies Department of the School of Education could be | 
used by him. The student teachers were doing their practice 
teaching during the months of February and March, 1949. As 
the study had been planned to cover the schools of the Greater 
Boston area this arrangement was very fortunate. The writer 
is very grateful for the opportunity to use these facilities. 

The tests were prepared and packaged in groups of fifty | 
booklets. A page of instructions was sent with each package. 
It was realized that some schools might have more than fifty 
in the class to be tested but it was known that a number of 
the schools would have fewer than fifty. 

It was hoped that ten schools might be tested but this 
was not possible. Enough booklets were prepared so that ten 
schools might be tested. It was found convenient to administer 
the test only in six schools of the Greater Boston area. These 
schools are Arlington High School, Medford High School, Melrose 
High School, Newton High School, Quincy High School, and 
Watertown High School. 


The writer is aware of the inconvenience that extra 


— 
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testing can be to the classroom teacher and appreciates their 
cooperation. The schools which participated were guaranteed 
that they would receive the results of the testing. In fact 
all statistical data derived from the testing was sent to the 
schools in the form of a report. This was not done until 
some time after the testing took place because of the time 
necessary for the analysis of the data. 

Most of the test booklets were taken to the schools by 
Professor W. H. Cartwright snd Mr. Warren J. Loring, Graduate 
Assistant at Boston University, School of Education. The 
tests were administered by the classroom teachers and the forms 
were returned to the School of Education. This procedure 
worked successfully due to the cooperation of all persons 
concerned. The tests were not returned by the schools. 
Instructions to that effect were sent with the package of test. 
booklets. 

In order that the results of the pupils might be com- 
pared with suitable criteria and in order to validate the key 
to the test, it was decided that a group of experts should 
take the test. This was accomplished through the cooperation 
of ten well-informed social studies majors. The ten experts 
included four social studies teachers and six social studies 
majors, five of whom were graduate students and one a college 
senior. This group took the test under conditions as near as 


possible to the conditions under which the pupils worked. The 


expert group was asked to comment on the various items. The 

results of the tabulation of their comments will be discussed 
) later in the conclusions of the study. The writer feels that 

his key is valid after a close study of the expert group test 


results. 
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INSTRUCTIONS FOR TEACHER ADMINISTERING TEST 


15 February 1949 


1. The test is designed for twelfth grade pupils who have 
studied or who are studying Problems of Democracy or Current 
Events. 

2. The test is self-explanatory in that directions are 
given for each part. 

3- Instruct the pupils to write the number of their test 
sheet in the upper right hand margin of the answer sheet. 

4. The pupils will be informed of the results of the test 
by the number on their answer sheet. Therefore pupils wishing. 
to know their results should keep a record of this number. 

5. The answer sheets should be returned to Mr. Cartwright or 
Mr. Loring as soon as possible. 

6. The test booklet itself need not be returned with the 


answer sheet. 


Thank you very much. 
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CHAPTER IV 


ANALYSIS OF DATA 


The following charts represent the results of the 
statistical analysis. Each school which participated in the 
study was given an alphabetical letter. The results of each 
school by its own name is known only to the writer and to the 
school itself. 

An item analysis was made from the results from each 
school. The number of correct responses for each item was 
figured and the percentages are available in the following 
charts. The item analysis can be seen in the appendix. A 
study of this chart will show the strength of each distractor. 
The percentages of response to each distractor was not computed 
on a percentage basis. 

The medians, range of scores, and standard deviations 
for both the schools and the expert group are given in the 
charts in this chapter. 

The quartile deviation for the two hundred and twenty 
five cases is also given in the charts. 

All the data mentioned above was reported to the schools 


as soon as it was available. 
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ITEM ANALYSIS OF TEST 
PERCENTAGE OF CORRECT RESPONSES 
) ITEM NO: SCHOOL A SCHOOL B: SCHOOL C: 

Ts 84% 76% 91% 
ay 63% 36% 46% 
Sie 76% 72% 75% 
4, 96% 96% 87% 
Be 34% 16% 31% 
6. 75% 44% 70% 
a 73% 52% 54% 
8. 76% 36% 43% 
ce 98% 68% 87% 
10. 94% 72% 58% 
ce 98% 92% 95% 
12. 98% 96% 97% 
1B. 92% 80% 89% 
14. 73% 48% 70% 
15. 78% 88% 83% 
16. 76% 52% 60% 
Ay 96% 88% 89% 
18. 71% 92% 81% 
52% 31% 

88% 81% 

92% 85% 

92% 91% 


586 


42. 


45. 


SCHOOL A: 


88% 
84% 
75% 
96% 
86% 
100% 
63% 
94% 
55% 
100% 
80% 
84% 
65% 
84% 
63% 
100% 
75% 
86% 
96% 
92% 
94% 
92% 
86% 


SCHOOL B: 


92% 
72% 
64% 
100% 
84% 
84% 
36% 
76% 
36% 
80% 
68% 
64% 
44% 
48% 
36% 
100% 
52% 
88% 
84% 
56% 
76% 
88% 


72% 


SCHOOL C: 


91% 
62% 
56% 
100% 
66% 
17% 
54% 
85% 
29% 
89% 
87% 
70% 
20% 
81% 
54% 
95% 
45% 
79% 
83% 
85% 
75% 
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ITEM NOs SCHOOL A: SCHOOL B: SCHOOL C: 
46. 69% 28% 47% 
) 47. 92% 88% O7% 
48. 90% 80% 64% 
49. 51% 20% 20% 
50. 65% 56% 29% 
Sli 63% 56% 31% 
52. 98% 84% 89% 
SB. 94% 84% 89% 
54. 71% 52% 91% 
55. 59% 32% 52% 
56. 80% 40% 81% 
57s 63% 68% 50% 
58, 59% 52% 29% 
59), 65% 48% 45% 
60. 76% 24% 43% 
61. 65% 20% 54% 
62. 67% 28% 39% 


ITEM NO: 


1. 
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15. 


18. 
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ITEM ANALYSIS OF TEST 


SCHOOL Ds: 


89% 
54% 
64% 
91% 
29% 
718% 
51% 
68% 
91% 
94% 
94% 
97% 
100% 
68% 
70% 
70% 
97% 
100% 
54% 
91% 
97% 
97% 


SCHOOL E: 


90% 
59% 
88% 
97% 


SCHOOL F: 


100% 
78% 
73% 
95% 
47% 
73% 
57S 
57% 
89% 
84% 

100% 

100% 
95% 
57% 
78% 
73% 

100% 
63% 
13% 
84% 


100% 
95% 
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ITEM NOs 


256 
24, 
L256 
26. 
ole 
286 
29. 
30. 
Sl. 
326 
356 
34-6 
356 
566 
S76 
386 
39.6 
40. 
41. 
42. 
43. 
44, 


45. 


SCHOOL D; 


83% 
75% 
100% 
94% 
97% 
45% 
91% 
54% 
59% 
97% 
78% 
70% 
59% 
75% 
94% 
70% 
100% 
89% 
91% 
100% 
100% 
10% 
72% 


SCHOOL Bs 


70% 
68% 
93% 
88% 
100% 
36% 
86% 
50% 
70% 
90% 
63% 
54% 
79% 
40% 
97% 
68% 
59% 
86% 
88% 
88% 
90% 
75% 
59% 


SCHOOL F; 


68% 
63% 
100% 
95% 
95% 
13% 
100% 
57% 
100% 
94% 
73% 
52% 
89% 
52% 
100% 
68% 
78% 
94% 
89% 
100% 
94% 
94% 


68% 
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ITEM NO. 


46. 
47. 
48. 


SCHOOL D; SCHOOL E. SCHOOL F; 


61% 89% 


97% 100% 


68% 
26% 
57% 


52% 
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18% 
19. 
206 
21. 
226 


PERCENTAGES OF CORRECT RESPONSE BY 225 CASES 


88.4% 
55.5% 
76.0% 
93.7% 
25.3% 
70.2% 
50.2% 
56.0% 
90.2% 
TTate 
96.3% 
96.8% 
92.0% 
66.62 
78.2% 


67.5% 


74.6% 
57.3% 
87.5% 
93.3% 
92.0% 


256 
24.6 
256 
26. 
27. 
28.6 
296 
306 
ol. 
S26 
O56 
34.6 
O56 
566 
Sv. 
386 
396 
40. 
4l. 
426 
43. 
44, 


45. 
46. 
47. 
48. 
49. 
50. 
Sl. 
526 


556 


62.66 
57 cop 
94.6% 
78.2% 
35558 
51.5% 
57.3% 
93.7% 
80.4% 
74.2% 
59.1% 
73.03% 
57.7% 
53.7% 
54.6% 
64.0% 
5501 


52.4% 
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ITEM ANALYSIS OF EXPERT GROUP RESULTS 


ITEM NO: CORRECT RESPONSES OF EXPERT GROUP IN PERCENT 


1. ~6YO% 25. 104% 45. 100% 
2. 90% 24. 100% 46. 90% 
Ss 50% 25. 100% 47, 90% 
4. 80% 26. 100% 48. 100% 
5. 40% 27. 100% 49. 80% 
6. 90% 28. 90% 50. 100% 
7. 60% 29. 100% 5l« 100% 
8. 90% 30. 100% 52. 100% 
9. 100% Sis. 90% 53. 100% 
10, 100% 22) 106% 54. 80% 
11. 100% 336 100% 55. 100% 
12. 90% 34. 100% 56. 100% 
LS. 100% 35. 100% 57. 60% 
14, 90% 36. 100% 58. 90% 
15. 100% 37. 100% 59. 100% 
16. 80% 38. 100% 60. 90% 
17. 100% 39. 100% 61. 90% 
18. 100% 40. 100% 62. 90% 
19. ‘70% 41. 100% 
20. 100% 42. 100% 
21. 100% 43. 100% 


22. 100% 44, 100% 
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COMPARISON OF PERCENTAGES OF CORRECT RESPONSES 


SCHOOLS 


88.4% 
55.5% 
76.0% 
93.7% 
25.35% 
70.2% 
50.2% 
56.0% 
90.2% 
si 
96.8% 
96.8% 
92.0% 
66.6% 
78.2% 
67.5% 
94.2% 
74.6% 
57.5% 
87.5% 
93.3% 
92.0% 


EXPERT 
70.0% 
90.0% 
30.0% 
80.0% 
40.0% 
90.0% 
60.0% 
90.0% 
100% 
100% 
100% 
90.0% 
100% 
90.0% 
100% 
80.0% 
100% 
100% 
70.0% 
100% 
100% 
100% 


NO. 


25-6 
24. 
256 
266 
27. 
28. 
29. 
506 
Sle 
S26 
S56 
54. 
356 
566 
37.6 
58.6 
396 
40. 
41. 
42. 
43. 
44, 


SCHOOLS 


74.2% 
67.5% 
97.7% 
84.4% 
92.4% 
51.1% 
88.3% 
46.6% 
83.3% 
86.6% 
Tess 
51.7% 
70.5% 
55.1% 
97.7% 
63.5% 
81.7% 
97.7% 
86.7% 
88.4% 
97.7% 


75.1% 


EXPERT 
70.0% 
100% 
100% 
100% 
100% 
90.0% 
100% 
100% 
90.0% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
100% 
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SCHOOLS 


62.6% 
57.3% 
94.6% 
78.2% 
Sy 4 
51.5% 
57.25% 
93.7% 
80.4% 


EXPERT 


100% 
90.0% 
90.0% 
100% 
80.0% 
100% 
100% 
100% 
100% 
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SCHOOLS 


74.2% 
59.1% 
13.3% 
57.7% 
55.70 
54.6% 
64.0% 
55.1% 
52.4% 


EXPERT 


80.0% 
100% 
100% 
60.0% 
90.0% 
100% 
90.0% 
90.0% 
90.0% 
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STATISTICAL DATA ON SCHOOL GROUP AND EXPERT GROUP 


RANGE OF SCORES MEDIAN 
SCHOOL A 44-56 49.71 
SCHOOL B 32-51 41.50 
SCHOOL C 32=52 39.00 
SCHOOL D 36-57 47637 
SCHOOL E 35-57 44.66 
SCHOOL F 40-58 47.25 
EXPERT GROUP 54-60 57.76 
Median for 225 cases in six schools 46.166 


Quartile Deviation of 225 cases in 
six schools Qz 48.72 


Q, 41.90 
Qy “S542 


Standard Deviation of 225 cases in 
six schools 5680 


Standard Deviation of expert group 
of ten cases Le ok 
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CHAPTER V 
SUMMARY AND CONCLUSIONS 


Six high schools were used in the study. The number 
of cases in each school varied as follows: 


lame of School Number of Pupils 


Newton 52 
Quincy 25 
Arlington ng 
Medford 48 
Malden 37 
Watertowm 44 

225 


Two hundred ‘and twenty-five cases were not as many as 
had been hoped for by the writer. However, it is felt that 
this number of cases gave a good cross section of the Greater 
Boston areae The six schools listed above are located in 
ereas of varying economy and national groups. Perhaps a 
larger number of schools would have given the study more 
validity but the writer feels that the six schools gave a 
representative view of the situation. 

Conclusions that can be drawn from the data are pre= 
sented in the following Apever en <8 

Ae ‘The item analysis of the results of the 225 cases 


showed thats: 


1) Item #5 was answered correctly by 25.5 percent 


bl. ee Se eee ae ; Resta 
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2) Item #30 was answered correctly by 46.4 percent 
ef the pupils. h 

5) -Eveug 7277, °8,° 19, 2ey°Ss4; 46,49, 60, SI, 55; 
57, 58, 59, 61, and 62 were answered correctly by 51.1 - 5763) 
percent of the pupils. 

4) Forty-four items were answered correctly by more | 
than sixty percent of the pupils. 

5) No item was answered correctly by all the pupils. 

6) Part III of the test, which consisted of reverse | 
multiple choice items caused the most difficulty, as evidenced 
by "3" above which shows that items #55, 57, 58, 59, 61, and 
62 were answered correctly by less than 58 percent of the 
pupils. They make up five-ninths of the items in Part III. 
The information asked for in these items was of the same 
nature as that in Part I and Part II. 

7) Pupils who answered the reverse multiple choice 
items correctly generally received high scores. 

B. The item analysis of the expert group results 

showed that: 

1) Item #3 was answered correctly by 30 percent of 
the experts. 

2) Item #5 was answered correctly by 40 percent of 
the experts. 

3) Items #7 and 57 were answered correctly by 60 per- 


cent of the experts. 


4) Items #1, 19, and 23 were answered correctly by 
70 percent of the experts. 

5) Items #4 and 16 were answered correctly by 80 per- 
cent of the experts. 

G)) Items 42,.'65¢8,°22,592456285731, 46, 47, 58, 60, 
61, and 62 were answered correctly by 90 percent of the 
experts. 

7) Thirty-eight items were successfully answered by 
the entire expert group. 

Ce. Comparison of results of both groups from the data 
of the item analysis shows that: 

1) Item #3 should be improved or eliminated. 76 per- 
cent of the pupils answered it correctly and 30 percent of 
the expert group answered it correctly. The item is stated 
as follows: 

"3. The General Assembly of the United Nations limits 
national sovereignty due to the fact that: 
*#a) all nations have an equal voice and vote 
b) minor decisions require only a simple majority 
ec) it may look into any matter not being considered 
by the Security Council at the same time 
d) major decisions are made by a three-fourths vote 
of the members present," 

2) Items #2, 5, 7, and 19 were answered correctly by 
less than 60 percent of either pupil or expert group. They 
have been carefully checked by the writer and found to be 


legitimate questions requiring factual knowledge. These 
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items are stated in thetest as follows: 


RO. 


formation about foreign powers of every hemisphere 


is the: 
#a) Central Intelligence Agency 

b) G-2 

c) Federal Bureau of Investigation 

d) Counter Intelligence Corps. 

"5, At the 1948 meeting of the General Assembly of the 


United Nations: 


"19, 


keeping peace with the Arab League is the: 


Items #2, 5, 7, and 19 were commented upon favorably by 
the expert group despite their relatively poor performance. 
It is felt that they should remain in the test. 
ficult but useful items. 


less than 50 percent correct response by the pupil group. In 


An organization whose duty it is to collect in- 


an important statement of human rights was adopted 
progress was made in settling the Palestine problem 
Austria was granted United Nations membership 
important action was taken toward writing the peace 
treaty for Germany. 


The Security Council of the United Nations: 


has seven permanent members 

usually meets at Lake Success, New York 

is the most powerful branch of the United Nations 
often bows to the authority of the General eerombty 


The primary interest of the United States in 


presence of oil deposits in the Near East 

desire to keep Russia out of the area 

position of the Suez Canal 

maintenance of existing trade agreements with Near 
Eastern countries." 


They are dif- 


There were four items which received 
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a test of sixty-four items this number is to be expected. 

The chief interest in the study is, of course, the per- 
formance of the high school pupils. The writer believes that 
their performance was excellent. The range of scores was sur- 
prisingly small. There were no scores which were very lowe 
The lowest score was thirty-two points out of a possible sixty- 
two points. The highest score received was fifty-eight out of 
a possible sixty-two points. 


The medians of the six high schools merit some een 


They range from 39.00 to 49.71. This is higher than the writes 
had expected and comes as a very pleasant reminder of the 
excellent work that is being done in the schools of this area. 
The median of the entire group is 46.166. This is also 
higher than had been expected by the writer or the professors 


who had helped in the construction of the teste There is 


also a surprisingly small difference between the median of the 
entire pupil group and the expert group, which received a 
median of 57.76. 

The Standard Deviation may be taken into consideration. 
It shows that the S.D. for the pupil group is 5.80. This 
shows a small spread of score. The S.D. of the expert group 
is 1.21. The small amount of spread in the scores of this 


group is to be expected. 


The test has also been analyzed in order to find out 


which parts of the outline were answered with the most success 
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It has been found that questions on government and military 
personalities were answered correctly by the greatest number 
of pupils. These items were answered correctly by 35.3 = 
97.7 percent of the group. Eight of the sixteen questions in 
this category were answered correctly by more than 80 percent 
of the pupils. It was also found that questions on the 

United Nations rank second in number of successful responses. 
There were fourteen questions on this topic. The range of 
correct responses range from 25.3 - 93.0 percent. Five of the 
items were answered correctly by more than 75 percent of the 
pupils. It was also found that the section which consisted 


of reverse multiple choice questions caused the most difficult 


for the pupil group. Items #55, 57, 58, 59, 61, and 62 were 
answered correctly by less than 58 percent of the pupils. 
This does not mean that this type of item is not valid but it 
does raise the question of whether it added materially to the 
effectiveness of the test. Comments from the expert group 
indicate that the information desired might well have been 
stated in multiple choice questions of the type in Part I. 
A typical reniark from the expert group is, "I spent more time 
on the mechanics of the question than on solving it." 

This study has been an attempt to determine pupil 
knowledge in the area of American Post-War International 
Affairs and a conscientious effort has been made to make this 


a valid study. The results of the test have been gratifying. 


oe aes ee ae er = ne 


Xx 
The writer is convinced that the schools of the area are 


doing a good job in a field that is both interesting and 
eritical. 
It is thought that a longer test and more cases would 
show more clearly the exact status of such information but it 
would probably not show results which vary greatly from the 
data in this study. 
It is hoped by the writer that this study has been of 
some value to the schools which participated in the study. 
An effort has been made to share with them in all the findings 
Little ie known about this field since testing has obviously 
been meagre. 
As a final suggestion the writer recommends that a 
test be constructed which does not consist of items of too 
ae interest. The expert group was tested after the ; 
pupils had been tested and it was necessary to explain that 
several Atowe had to be answered as of February 1949. This 
detracts from the validity of a test. 
Finally, the writer wishes to thank again all the 


persons who made this study possiblee 
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